Scanning device

ABSTRACT

Example methods, apparatuses and systems are disclosed for providing a device for capturing a barcode image within an augmented reality environment. An example method includes detecting a target object within a field of view of an augmented reality viewing device. The method further includes rendering an image of a scanning device within the field of view of the augmented reality viewing device, and rendering a scanning area within the field of view of the augmented reality viewing device. Further, a camera associated with the augmented reality viewing device captures an image of a barcode located on the target object. Corresponding apparatuses, systems, and computer program products are also provided.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation application of and claims the benefitof priority to U.S. application Ser. No. 16/288,274 entitled “SCANNINGDEVICE” filed on Feb. 28, 2019, which is a continuation application ofand claims the benefit of priority to U.S. application Ser. No.15/720,149 entitled “SCANNING DEVICE” filed on Sep. 29, 2017,subsequently issued as U.S. Pat. No. 10,254,548. The entirety of each ofthe foregoing applications is incorporated by reference herein.

TECHNOLOGICAL FIELD

Example embodiments of the present invention relate generally to barcodescanning devices and, more particularly, to methods and apparatuses thatprovide for barcode scanning within an augmented reality systemenvironment.

BACKGROUND

The use of barcodes and other scannable images has proven to be aneffective and popular approach to labeling and identifying products. Inmany situations involving barcodes, handheld scanning devices are usedto read the barcode and convey the barcode information to a systemcapable of decoding the barcode and accessing the information associatedwith the barcode.

Applicant has identified a number of technical challenges associatedwith conventional barcode scanning systems and other associated systemsand methods. Through applied effort, ingenuity, and innovation, many ofthese identified challenges have been overcome by developing solutionsthat are included in embodiments of the present invention, many examplesof which are described in detail herein.

SUMMARY

In many environments and situations involving the use, detection, andscanning of barcode images, a handheld scanning device is operated by auser to read or otherwise capture the barcode image and to convey thebarcode image information to a system capable of decoding and/orotherwise processing the barcode image information. In someenvironments, the reliance on a handheld scanner results in an unwieldy,cumbersome, inefficient, and time-consuming series of operations. Forexample, in a warehouse environment where a user is responsible foracquiring multiple items distributed throughout the area of thewarehouse, a user may not be able to devote a band to carrying andoperating a handheld scanner, particularly if two hands are necessary toposition an item for scanning, maneuver a cart or other vehicle throughthe warehouse, operate other equipment, or otherwise safely performother essential tasks. As such, a user may be forced to regularly putdown the handheld scanner and risk misplacing or forgetting the scanner,or to attempt maneuvers that may place the user at risk for injuryand/or the item or scanner at risk for damage. These challenges arecompounded in situations where, in addition to a handheld scanner, auser must carry and use additional equipment to interpret theinformation derived from a scanned barcode.

To address these and other technical challenges, example embodiments ofthe invention disclosed herein involve the use of an augmented realityviewing system, such as a binocular augmented reality headset, forexample, to render an image of a barcode scanner in the field of view ofthe user and, through the operation of a camera integrated into and/orotherwise associated with the augmented reality viewing system, capturethe image of a barcode located on a target object within the field ofview of the user.

In a first example embodiment, a method is provided for capturing abarcode image within an augmented reality environment. The method mayinclude detecting a target object within a field of view of an augmentedreality viewing device, such as, but not limited to, a binocularaugmented reality headset. The method may further include rendering animage of a scanning device within the field of view of the augmentedreality viewing device. Further, the method may include rendering ascanning area within the field of view of the augmented reality viewingdevice, in some embodiments, the augmented reality viewing device mayhave a camera associated with the augmented reality viewing device. Insuch embodiments, the method may include capturing an image of a barcodelocated on the target object by the camera associated with the augmentedreality viewing device.

In some embodiments, rendering the image of the scanning device, asdescribed above, may include rendering a three-dimensional image of thescanning device.

In some embodiments, rendering the scanning area within the field ofview of the augmented reality viewing device, as described above, mayinclude rendering a representation of an active read area of the cameraassociated with the augmented reality viewing device. Further, themethod may further include rendering the representation of the activeread area of the camera in a first color. The method may further includedetermining if the target object is located within the active read areaof the camera, and based, at least in part on determining that thetarget object is located within the active read area of the camera,rendering the representation of the active read area of the camera in asecond color.

In some embodiments, capturing the image of the barcode, as describedabove, may include removing the image of the scanning device from thefield of view. Additionally or alternatively, capturing the image of thebarcode may cause an audible sound to be emitted from the augmentedreality viewing device.

In a further embodiment, the augmented reality viewing device mayinclude a binocular augmented reality headset.

In another example embodiment, an apparatus is provided for capturing abarcode image within an augmented reality environment. The apparatus mayinclude a processor for detecting a target object within a field of viewof the apparatus. The processor may render an image of a scanning devicewithin the field of view of the apparatus. Further, the processor mayrender a scanning area within the field of view of the apparatus. Insome embodiments, the apparatus may have a camera associated withapparatus. In such embodiments, the processor may cause the camera tocapture an image of a barcode located on a target object.

In some embodiments, rendering the image of t be scanning device, asdescribed above, may include rendering a three-dimensional image of thescanning device.

In some embodiments, rendering the scanning area within the field ofview of the apparatus, as described above, may include rendering arepresentation of an active read area of the camera associated with theapparatus. Further, the processor may render the representation of theactive read area of the camera in a first color. The processor mayfurther determine if the target object is located within the active readarea of the camera, and, based at least in part on determining that thetarget object is located within the active read area of the camera, mayrender the representation of the active read area of the camera in asecond color.

In some embodiments, capturing the image of the barcode, as describedabove, may include removing the image of the scanning device from thefield of view. Additionally or alternatively, capturing the image of thebarcode may cause an audible sound to be emitted from the apparatus.

In another example embodiment, a computer program product havingnon-transitory computer readable storage medium is provided. The nontransitory computer readable storage medium includes computer-executableprogram code stored therein. Further, the computer-executable programcode may include program code instructions for capturing a barcode imagewithin an augmented reality environment. The computer program productmay include program code instructions to detect a target object within afield of view of the augmented reality viewing device. The computerprogram product may further include program code instructions to renderan image of a scanning device within the field of view of the augmentedreality viewing device, render a scanning area within the field of viewof the augmented reality viewing device, and capture, by a cameraassociated with the augmented reality viewing device, an image of abarcode located on a target object.

In some embodiments, the computer program product may further includeprogram code instructions to render a three-dimensional image of thescanning device.

In some embodiments, the computer program product may further includeprogram code instructions to render a representation of an active readarea of the camera associated with the augmented reality viewing device.Further, the computer program product may include program codeinstructions to render the representation of the active read area of thecamera in a first color, determine if the target object is locatedwithin the active read area of the camera, and, based at least in parton determining that the target object is located within the active readarea of the camera, render the representation of the active read area ofthe camera in a second color.

In some embodiments, the computer program product may include programcode instructions to removing the image of the scanning device from thefield of view on capturing the image of the barcode. Additionally oralternatively, the computer program product may include program codeinstructions to cause an audible sound to be emitted from the apparatuson capturing the image of the barcode.

In yet another embodiment, a system for capturing a barcode image withinan augmented reality environment is provided. The system may include anaugmented reality viewing device having a processor for detecting atarget object within a field of view of the augmented reality viewingdevice. The processor may render an image of a scanning device withinthe Field of view of the augmented reality viewing device. Further, theprocessor may render a scanning area within the field of view of theaugmented reality viewing device. In some embodiments, the system mayinclude a camera associated with the augmented reality viewing device.In such embodiments, the camera may capture an image of a barcodelocated on a target object.

The above summary is provided merely for purposes of summarizing someexample embodiments to provide a basic understanding of some aspects ofthe invention. Accordingly, it will be appreciated that theabove-described embodiments are merely examples and should not beconstrued to narrow the scope or spirit of the invention in any way. Itwill be appreciated that the scope of the invention encompasses manypotential embodiments in addition to those here summarized, some ofwhich will be further described below.

BRIEF DESCRIPTION OF THE DRAWINGS

Having described certain example embodiments of the present disclosurein general terms above, reference will now be made to the accompanyingdrawings, which are not necessarily drawn to scale.

FIG. 1 is a system diagram illustrating aspects of an exampleimplementation an example embodiment described herein.

FIG. 2 is an illustration of an example view that may be presented to auser in accordance with an example implementation of an exampleembodiment described herein.

FIG. 3 is a schematic block diagram, illustrating aspects of an exampleimplementation in accordance with an example embodiment describedherein.

FIG. 4 is a schematic block diagram of an example apparatus and relatedcircuitry embodying an augmented reality viewing device that may performoperations in accordance with some example embodiments described herein.

FIG. 5 illustrates a flowchart describing example operations performedby an augmented reality viewing device, in accordance with some exampleembodiments described herein.

DETAILED DESCRIPTION

Some embodiments of the present invention will now be described morefully hereinafter with reference to the accompanying drawings, in whichsome, but not all embodiments of the inventions are shown. Indeed, theseinventions may be embodied in many different forms and should not beconstrued as limited to the embodiments set forth herein; rather, theseembodiments are provided so that this disclosure will satisfy applicablelegal requirements. Like numbers refer to like elements throughout. Asused herein, the terms “data,” “content,” “information,” and similarterms may be used interchangeably to refer to data capable of beingtransmitted, received, and/or stored in accordance with embodiments ofthe present invention. Thus, use of any such terms should not be takento limit the spirit and scope of embodiments of the present invention.

The word “exemplary,” when used herein, is intended to mean “serving asan example, instance, or illustration.” Any implementation describedherein as “exemplary” is not necessarily preferred or advantageous overother implementations.

The term “augmented reality” is used herein to refer to a composite viewpresented to a view that includes generated images and/or text that aresuperimposed on the user's view of the existing environment. In thisregard, some augmented reality implementations include, but are notlimited to, the superimposition or other application of generated textand/or images onto a live video stream captured by a camera that isaligned with a user's field of view. Some augmented realityimplementation include, but are not limited to, the superimposition oftext or images on a display that allows the user to simultaneously viewthe superimposed content and the surrounding environment. The term“augmented reality viewing device” is used herein to refer to any deviceconfigured to present augmented reality content to a user. For example,the Microsoft Hololens head-mounted viewing device is an example of anaugmented reality viewing device that is capable of superimposing imagesand/or text onto displays placed in front of each of a viewer's eyes. Itwill be appreciated that a mobile device, such as a smart phone ortablet computer, for example, may also be configured to presentaugmented reality content to a user.

The term “scanning device” is used herein to refer to any device capableof scanning a barcode or similar image. As described herein, someexample implementations of embodiments of the invention involverendering, in an augmented reality environment, an image of a scanningdevice. In some of the example implementations presented herein, thescanning device is a handheld barcode scanner. However it will beappreciated that the term “scanning device” encompasses any devicecapable of scanning a barcode. Moreover in example implementationsinvolving the rendering and/or presentation of an image of a scanningdevice, the image of the scanning device need not duplicate the exactappearance of any particular scanning device, and may, for example,present a generic scanning device and/or incorporate design elementsand/or other image aspects that are not present on any physicallyexisting scanning device.

The term “target object” is used herein to refer to any object, item,article, surface, or the like, placed in a field of view of a scanningdevice to be scanned. As described herein, in some exampleimplementations of embodiments of the invention, the target object hasan encoded indicia, such as a barcode for example, located on the targetobject. In this regard, the scanning device may capture an image of thebarcode located on the target object. By way of an example arising in aretail and/or a warehouse environment, inventory may be tracked byscanning a decodable indicia, such as a barcode placed on each item inthe retail store and/or the warehouse. In this regard, each item thatincludes a decodable indicia in a field of view of a scanning device maybe referred to as a “target object” for the scanning device.

Overview

The present disclosure relates to methods, apparatuses, and computerprogram products for capturing a barcode image within an augmentedreality environment. Many environments involve the use, detection, andscanning of decodable indicia, such as barcode images, for inventorymanagement and/or tracking. As such, a handheld scanning device may beoperated by a user to read or otherwise capture the barcode image andconvey the barcode image information to a system capable of decodingand/or otherwise processing the barcode image information. However, insome scenarios, such as a warehouse environment, a user may not be ableto devote a hand to carrying and operating a handheld scanner,particularly if two hands are necessary to position an item forscanning, maneuver a cart or other vehicle through the warehouse,operate other equipment, or otherwise safely perform other essentialtasks. Thus, in such scenarios, it may be desirable to use a wearabledevice, such as a headset, and more specifically, an augmented realityviewing device, to read and/or capture images of decodable indicia, suchas barcodes, while allowing the user to use both hands to perform otheressential tasks safely.

Some example implementations of embodiments of the invention involve theuse of an augmented reality viewing device that is fitted with a cameraand/or other image scanner capable of capturing a barcode image. Suchexample implementations contemplate using the augmented reality viewingdevice to replace a handheld scanner or other similar scanning device,freeing the user to use two hands to manipulate, move, and/or otherwisehandle target objects. In this regard, the augmented reality viewingdevice, which may be configured as a head-mounted device, may detect atarget object when the target object is located within a field of viewof the camera and/or other image scanner incorporated into tireaugmented reality viewing device. In some embodiments, the target objectmay include a decodable indicia, such as a barcode, located on a surfaceof the target object. One of the technical challenges associated withusing a head-mounted display or other augmented reality viewing deviceto assist in the capture of a barcode or other decodable indicia is thedifficulty in rapidly aligning the target object within the camera in amanner that allows for the camera to readily capture the barcode imageon the target object. Other technical challenges arise in casing theinterface between the human user and the head-mounted display or otheraugmented reality device, particularly in situations where a user hasgrown accustomed to using a handheld scanner to capture barcode images.

To address these and other technical challenges, the augmented realityviewing device may generate and present an image of a scanning device toa user via the display of the augmented reality viewing device. In someexample implementations, the image of the scanning device issuperimposed on the view presented to the user. By presenting an imageand/or representation of a traditional scanning device in the viewpresented to a viewer, the user may more readily adapt to the use of theaugmented reality viewing device, align the target object with thescanning area of the camera associated with the augmented realityviewing device, and otherwise use the augmented reality viewing deviceto perform the image capture and/or barcode scanning operationsnecessary in a given environment. In some example implementations, athree-dimensional image of a scanning device may be presented in a Heldof view of the user. It will be appreciated that depiction of thescanning device (including but not limited to a three-dimensional imageof the scanning device) need not duplicate the exact appearance of anyparticular scanning device. For example, some example implementationsinvolve the presentation of a generic scanning device and/or and image,of a scanning device that incorporates design elements and/or otherimage aspects that are not present on any physically existing scanningdevice.

In such example implementations, and regardless of the preciseappearance of the image of a scanning device rendered in the viewpresented to the user, the user is provided with a scanning aid in thefield of view of the user for scanning decodable indicia, such as abarcode, located on the target object. For example, with respect torendering a three-dimensional image of a handheld scanner within thefield of view of a user, some example implementations of the inventionprovide a user with a frame of reference in the form a familiar tool,while eliminating the need for the user to physically handle andmanipulate the scanner during operations that may require two hands toperform safely.

In some example implementations, the augmented reality viewing devicemay render, in the view presented to a user, a depiction of a scanningarea of the augmented reality viewing device. In some such exampleimplementations, the scanning area may be presented in the form of atinted or otherwise colored region superimposed on the view presented tothe user. In some other example implementations, the scanning area maybe rendered or otherwise presented in the form of a three-dimensionalconical representation of a scan area of the augmented reality viewingdevice. Some example implementations allow for visual feedback to beprovided to the user based on the movement of a target object in and/oraround the scanning area of the augmented reality viewing device. Insome example implementations, the augmented reality viewing device mayrender the scanning area as a region presented in a first color. In suchexample implementations, the user may be able to determine whether atarget object (and particularly, a barcode image on a target object) iswithin the scanning area by visually determining whether the targetobject is within the colored region rendered in the view presented tothe user.

In some further example implementations, the augmented reality viewingdevice may detect if a target object and/or a decodable indicia, such asa barcode, is located within the scanning area, and may re-render thescanning area in a second color. In such example implementations, thepresence of a target object within the scanning area causes a switch inthe color used to render the scanning area. In other exampleimplementations, the scanning area may be presented in one color when notarget object is present in the scanning area, a second color when atarget object is determined to be positioned in the scanning area, and athird color when an image of the target object and/or a decodableindicia is captured. Thus, the scanning area may be rendered in variouscolors and/or other appearances in order to assist a user operating theaugmented reality viewing device for scanning a barcode located on atarget object to place the barcode and/or the target object within ascan range and/or a read area of the camera associated with theaugmented reality viewing device. This enables the user to rapidly andintuitively align the active scanning area of the augmented realityviewing device, such as a head-mounted device, so that the user canefficiently locate and scan images of a barcode without needing tomanipulate a physical scanner.

Turning to the FIGS. 1-3 , it will be appreciated that the componentsillustrated in the figures represent components that may or may not bepresent in various embodiments of the invention described herein suchthat embodiments may include fewer or more components than those shownin the figures while not departing from the scope of the invent ion.

While the present disclosure focuses on barcode scanning applications inan augmented reality environment, one or more embodiments of the presentdisclosure may be used for other purposes or in other environments, suchas to capture an image of a target object in a virtual and/or augmentedreality environment. The present disclosure may also be beneficial inany environment where it may be desired to provide an indication of aviewing area of a device, such as a camera, to serve as an aid for auser to position a target object in the viewing area for efficient andquick processing, such as image capturing.

FIG. 1 shows an example system 100 illustrating aspects of an exampleimplementation of an embodiment of the invention. FIG. 1 generallydepicts a relationship between a user 102, an augmented reality viewingdevice 104, a rendered image of a scanning device 106, and a targetobject 108 having a decodable indicia, such as a barcode 110. In someexample implementations, the augmented reality viewing device 104 iscapable of superimposing images and/or text onto displays placed infront of each of a viewer's eyes, such as, but not limited to, a smartphone, an eyeglass, a head gear, or the like. In the exampleimplementation shown in FIG. 1 , the augmented reality viewing device104 is in the form of a head-mounted device. Some such implementationsmay involve the use of head-mounted devices such as the MicrosoftHololens device. In particular, some example implementations contemplatethe augmented reality viewing device 104 is constructed as to feature abinocular arrangement that is capable of presenting different views toeach eye of the user 102. In some such binocular viewer arrangements,the augmented reality viewing device 104 is able to generate and useparallax effects that result from differing images being presented toeach eye of the user 102, such that the user 102 perceives athree-dimensional image of a scanning device 106, a scanning area,and/or other image. In some example implementations, such as theimplementation shown in FIG. 1 , the rendered image of the scanningdevice 106 may be perceived by the user 102 as being located in front ofthe user 102 and in the user 102's field of view.

It will be appreciated that while the image of a scanning device 106 isshown in FIG. 1 as a particular type of handheld scanning device, theimage of a scanning device 106 need not be limited to athree-dimensional image of a scanning device. Instead, the image 106 maytake on a broad range of appearances, such as that of existing scanningdevices, images that are recognizable as scanning-type devices, and/orother image capturing devices, for example. Further, the image of ascanning device 106 may include additional features, such as a handle,for a user to adjust a position and/or orientation of the image of thescanning device. In some example implementations, the augmented realityviewing device 104 may render additional images and/or text along withthe image of a scanning device 106 to provide additional information tothe user. For example, the augmented reality viewing device 104 mayrender an arrow near the image of a scanning device 106 indicating theuser to move the target object in the direction indicated by the arrowso as to bring the target object within the Held of view of theaugmented reality viewing device and/or an associated camera.

Further, a rendering position, location, and/or orientation of the imageof the scanning device may be predetermined relative to the user and/orthe augmented reality viewing device. The predetermined location may bestored in a memory of the augmented reality viewing device and/or may beaccessible to the augmented reality viewing device from a server and/ora cloud. In other embodiments, a rendering position, location, and/ororientation of the image of the scanning device 106 may be determined inreal time and/or near real time by the augmented reality viewing deviceand/or any associated circuitry. In an example implementation, therendered image of the scanning device 106 may be positioned in an activeread and/or scan area of the augmented reality viewing device 104.Further, the rendered image of the scanning device 106 may bedynamically moved within the Held of view of the user. For example, theimage of the scanning device 106 may be rendered in one location whilethe user is moving, and/or in another location when a scannable image isdetected in or near the read area of the camera.

By way of an example, augmented reality viewing device 104 may include acamera for capturing an image of a target object. The camera may have anassociated field of view such that placing the target object in thefield of view of the camera may enable the camera to capture an image ofthe target more efficiently and readily. In some embodiments, theaugmented reality viewing device 104 and/or an associated camera mayhave a region within their field of view where one or more imagecapturing parameters may be optimal. For example, in a specific area,referred to as active read and/or scan area of the augmented realityviewing device 104 and/or the camera, linage capturing parameters,including but not limited to, focus, brightness, exposure, and the likemay be optimal and/or close to optimal and/or otherwise suitable forcapturing a barcode image or the like.

In accordance with some example implementations of embodiments of theinvention, the user 102 may view a rendered image of the scanning device106 in the user 102's field of view. In order to capture an image of thetarget object 108 and/or barcode 110, the user 102 may use the renderedimage of the scanning device 106 as an image capturing aid indicating anactive scan and/or read area within the field of view of the augmentedreality viewing device 104. The user 102 may intuitively position thetarget object 108 having the barcode 110 in front of the rendered imageof the scanning device 106. In some example implementations, the user102 may hold the target object 108 in his/her hand and may position thetarget object 108 in front of the rendered image of the scanning device106. In other embodiments, where the augmented reality viewing device104 may be a wearable device, such as a head-mounted device, the user102 may move his/her head to move the rendered image of the scanningdevice 106, while the target object 108 may be stationary and/or fixed.In this regard, the user 102 may move and position the rendered image ofthe scanning device 106 in front of die target object 108 and/or thebarcode 110, thus moving the field of view and/or an active read or scanarea of the augmented reality viewing device 104 and/or an associatedcamera to align the field of view and/or an active read or scan areawith the target object 108 and/or the barcode 110.

Further, the augmented reality viewing device 104 and/or an associatedcamera may detect that a target object 108 and/or the barcode 110 islocated within the field of view of the augmented reality viewing device104 and/or the associated camera, and may capture an image of the targetobject 108. In some example implementations, capturing the image of thebarcode 110, may cause the augmented reality viewing device to removethe rendered image of the scanning device 106 from the field of view ofthe user 102. The image of the target object 108 may further beprocessed by the augmented reality viewing device 104 and/or anassociated processing system to decode the barcode 110. The decoded datamay be utilized by the augmented reality viewing device 104, a server,and/or other associated devices for various purposes, such as, inventorymanagement, shipment tracking, retail checkout and billing, and thelike.

FIG. 2 shows an example view 200 that may be presented to a user inaccordance with an example implementation of an embodiment of theinvention described herein. FIG. 2 illustrates a view seen through anaugmented reality viewing device 104, such as a binocular augmentedreality device, as described with reference to FIG. 1 . FIG. 2 shows aleft eye view 104 a presented to a left eye of the user 102 and a righteye view 104 b presented to a right eye of the user 102. As describedabove, by presenting a different view to each eye of the user 102, aparallax effect may be created and may cause the user 102 to perceive asuperimposed, three-dimensional image of a rendered scanning aid, suchas the rendered image of a scanning device 106, as shown in FIG. 1-2 .

In accordance with an example implementation, and as shown in FIG. 2 ,the left eye view 104 a may include a portion of the target object 108.Further, the right eye view 104 b may include the rest of the portion ofthe target object 108, the barcode 110, and a rendered image of thescanning device 106. Thus, a parallax effect may be created and the usermay perceive the rendered image of the scanning device 106 positioned ata distance in front of the user 102 within the user 102's field of view,as shown in FIG. 1 . While FIG. 2 depicts the rendered image of ascanning device 106 as being presented such that a user 102 wouldperceive it as being located in the space in front of the user 102'sright eye, it will be appreciated that images may be presented to theuser 102 via views 104 a and 104 b such that the user 102 may perceivethe location of the rendered image of the scanning device 106 in anylocation w ithin the available field of view.

FIG. 3 shows a schematic block diagram 300 illustrating aspects of anexample implementation of an embodiment of the invention describedherein. FIG. 3 illustrates an example depiction of an implementationinvolving presenting a scanning area 304 to a user 102 within a user102's field of view 302. In some example implementations, the scanningarea 304 may be rendered as a three-dimensional depiction of a scanningarea of a camera associated with the augmented reality viewing device104. In some such example implementations, the scanning area 304 maydepict an active read and/or scan area of the augmented reality viewingdevice 104 as perceived from the perspective of the user. As discussedabove, the augmented reality viewing device 104 may include anassociated camera and/or other scanning device for capturing an image ofa target object. The camera may have an associated field of view suchthat placing the target in the field of view of the camera may enablethe camera to capture an image of the target more accurately,efficiently, and/or readily. In some implementations, the scanning area304 may represent a specific area within the Held of view of theaugmented reality viewing device 104 and/or an associated camera whereone or more image capturing parameters, such as, focus, lighting,exposure, or the like, may be optimal and/or otherwise sufficient forcapturing an image, such as a barcode image.

In some example implementations, the scanning area 304 may be renderedas a three-dimensional conical area expanding from the augmented realityviewing device 104 depicting a field of view of the camera associatedwith the augmented reality viewing device 104. Additionally oralternatively, the scanning area 304 may include a rendering of arepresentation of the active read area of the camera, as describedabove, in a first color. Further, the augmented reality viewing device104 and/or the associated camera may detect if the target object 108 islocated within the scanning area 304. If the target object 108 and/orthe barcode 110 is determined to be located within the scanning area304, the augmented reality viewing device 104 may render therepresentation of the active read area of the camera in a second color.By way of an example, the scanning area 304 may be rendered as athree-dimensional area of red color within the field of view 302 of theuser 102 depicting the active read area of the camera associated withthe augmented reality viewing device 104. The user 102 may bring atarget object, such as the target object 108 having a barcode 110 shownin FIGS. 1-2 , within the scanning area 304 to scan and read the barcode110. Once the augmented reality viewing device 104 and/or the associatedcamera detects that the target object 108 and/or the barcode 110 iswithin the scanning area 304, the augmented reality viewing device 104may render the scanning area 304 in a green color, by way of an example.

Any approach to detecting a target object 108 within the scanning area304 of the augmented reality viewing device 104 may be used, includingbut not limited to depth sensing, infrared (IR) imaging, laser, thermalimaging, image recognition protocols, or the like. In some exampleimplementations, the augmented reality viewing device 104 may detect atarget object within a field of view of the augmented reality viewingdevice 104 by viewing and identifying a marker, such as a barcodelocated on the target object for example. In other implementations, theaugmented reality viewing device 104 and/or an associated camera maycompare an image of the object within the field of view of the augmentedreality viewing device 104 against a target object database foridentifying if the object is a target object.

By way of another example, the scanning area 304 may be presented in onecolor when no item is present in the scanning area 304, a second colorwhen a target object 108 is determined to be positioned in the scanningarea 304, and a third color when an image of the target object 108and/or the barcode 110 is captured. In another example implementation,the change in color of the scanning area 304 may be gradual, relative tothe area of the target object 108 and/or the barcode 110 within thescanning area 304. By way of the above example, the color of thescanning area 304 may gradually change from red, to a differentsaturation of red, to a specific saturation of green, to green as thetarget object 108 and/or the barcode 110 is brought within the scanningarea 304.

It should be noted that though the above description focuses on changinga color of the scanning area 304 as an indication to a user 102 that thetarget object 108 is positioned within the scanning area 304, theindication is not limited to just changing the color of the scanningarea 304. The indication may be provided by changing any graphicalcharacteristic of the scanning area 304, such as, but not limited to,line style, brightness, etc. In other example implementations, theindication may be provided as an alert on a display of the augmentedreality viewing device 104. In further embodiments, the indication maybe provided as a sound alert, such as a beep, generated by the augmentedreality viewing device 104 and/or any other associated device.

In some example implementations, when the object 108 and/or the barcode110 is detected as being located within the scanning area 304 by theaugmented reality viewing device 104, an image of the target object 108and/or the barcode 110 may be captured by the camera associated with theaugmented reality viewing device 104. In some example implementations,the image of the barcode 110 may be captured by the augmented realityviewing device 104 and/or the camera associated with the augmentedreality viewing device 104. In some other example implementations, theimage of the target object 108 may be captured by the augmented realityviewing device 104 and/or the camera associated with the augmentedreality viewing device 104, and may be processed to obtain detailsand/or other data from the barcode 110. In some such exampleimplementations, the image of the barcode 110 may be processed by theaugmented reality viewing device 104 to decode the barcode, or the imageof the barcode 110 or the target object 108 may be sent to a serverand/or any associated device for processing.

Further, in some example implementations, capturing the image of thetarget object 108 and/or the barcode 110 may further cause an alert,such as an audible sound to be generated by the augmented realityviewing device 104 and/or any other associated device.

The design of the various devices performing various example operationsis provided below.

System Architecture

Methods, apparatuses, and computer program products of the presentinvention may be embodied by any of a variety of devices. Exampleembodiments may include a plurality of devices operating a part of anaugmented reality viewing system.

Turning to FIG. 4 , an example apparatus 400 is illustrated that mayrepresent a basic set of components of a device embodying an exampleaugmented reality viewing device 104. The apparatus 400 may include aprocessor 402, a memory 404, and communications circuitry 406. Thedevice may further include input/output circuitry 408 for capturingimages, presenting text and/or images to a viewer in an augmentedreality environment, and/or otherwise interacting with a user, andbarcode capture circuitry 410 for recognizing and capturing barcodesand/or other scannable images in the scanning area of a camera or otherscanning device incorporated into the augmented reality viewing device104. The apparatus 400 may be configured to execute the operationsdescribed below in connection with FIG. 5 . Although these components402-410 are described with some functional descriptors, it should beunderstood that the particular implementations necessarily include theuse of particular hardware. It should also be understood that certain ofthese components 402-410 may include similar or common hardware. Forexample, the barcode capture circuitry 410 may leverage use of theprocessor 402, memory 404, communications circuitry 406, and/orinput/output circuitry 408 to perform their associated functions, andduplicate hardware is not required for the distinct components of theapparatus 400 (although embodiments using duplicated hardware are alsocontemplated herein). The use of the term “circuitry” as used hereinwith respect to components of the apparatus therefore includesparticular hardware configured to perform the functions associated withthe particular circuitry described herein. Of course, while the term“circuitry” should be understood broadly to include hardware, in someembodiments, circuitry may also include software for configuring thehardware components of the apparatus 400.

In some embodiments, the processor 402 (and/or co-processor or any otherprocessing circuitry assisting or otherwise associated with theprocessor) may be in communication with the memory 404 via a bus forpassing information among components of the apparatus. The processor 402may be embodied in a number of different ways and may, for example,include one or more processing devices configured to performindependently. Additionally or alternatively, the processor may includeone or more processors configured in tandem via a bus to enableindependent execution of instructions, pipelining, and/ormultithreading. The use of the term “processing circuitry” may beunderstood to include a single core processor, a multi-core processor,multiple processors internal to the apparatus, and/or remote or “cloud”processors.

In an example embodiment, the processor 402 may be configured to executeinstructions stored in the memory 404 or otherwise accessible to theprocessor. Alternatively or additionally, the processor may beconfigured to execute hard-coded functionality. As such, whetherconfigured by hardware or software methods, or by a combination ofhardware with software, the processor may represent an entity (e.g.,physically embodied in circuitry) capable of performing operationsaccording to an embodiment of the present invention while configuredaccordingly. Alternatively, as another example, when the processor isembodied as an executor of software instructions, the instructions mayspecifically configure the processor to perform the algorithms and/oroperations described herein when the instructions are executed.

In some embodiments, the memory 404 may be non-transitory and mayinclude, for example, one or more volatile and/or non-volatile memories.In other words, for example, the memory may be an electronic storagedevice (e.g., a computer readable storage medium). The memory 404 may beconfigured to store information, data, content, applications,instructions, or the like, for enabling the apparatus to carry outvarious functions in accordance with example embodiments contemplatedherein.

The communications circuitry 406 may be any means such as a device orcircuitry embodied in either hardware or a combination of hardware andsoftware that is configured to receive and/or transmit data from/to anetwork and/or any other device, circuitry, or module in communicationwith the apparatus 400. In this regard, the communications circuitry 406may include, for example, a network interface for enablingcommunications with a wired or wireless communication network. Forexample, the communications circuitry 406 may include one or morenetwork interface cards, antennae, buses, switches, routers, modems, andsupporting hardware and/or software, or any other device suitable forenabling communications via a network. Additionally or alternatively,the communication interface 406 may include the circuitry forinteracting with the antenna(s) to cause transmission of signals via theantenna(s) or to handle receipt of signals received via the antenna(s).These signals may be transmitted by the apparatus 400 using any of anumber of wireless personal area network (PAN) technologies, such asBluetooth® v1.0 through v3.0, Bluetooth Low Energy (BLE), infraredwireless (e.g., IrDA), ultra-wideband (UWB), induction wirelesstransmission, or the like. In addition, it should be understood thatthese signals may be transmitted using Wi-Fi, Near Field Communications(NFC), Worldwide Interoperability for Microwave Access (WiMAX), or otherproximity-based communications protocols.

In some embodiments, tire apparatus 400 may include input/outputcircuitry 408 that may, in turn, be in communication with processor 402to provide output to a user and, in some embodiments, to receive anindication of user input. In many of the example implementationsdescribed and/or otherwise contemplated herein, the input/outputcircuitry 408 will be involved with the output of augmented realitycontent to a display or other output device incorporated into theaugmented reality viewing device 104. For example, the input/outputcircuitry may interface with one or more displays (such as the binocularviewing arrangement in the Microsoft Hololens device, for example) topresent a rendered image of a scanning device to a user. Theinput/output circuitry 408 may comprise a user interface and may includea display that may include a web user interface, a mobile application, aclient device, or the like. In some embodiments, the input/output,circuitry 408 may also include a keyboard, a mouse, a joystick, a touchscreen, touch areas, soft keys, a microphone, a speaker, or otherinput/output mechanisms. The processor and/or user interface circuitrycomprising the processor may be configured to control one or morefunctions of one or more user interface elements through computerprogram instructions (e.g., software and/or firmware) stored on a memoryaccessible to the processor (e.g., memory 404, and/or the like).

In addition, the apparatus 400 also comprises barcode capture circuitry410, which includes hardware components designed to manage therecognition, capture, and/or decoding of a barcode presented to theaugmented reality viewing device 108. Barcode capture circuitry 410 mayutilize processor 402, memory 404, or other hardware component includedin the apparatus 400 to perform these functions. Barcode capturecircuitry 410 may further utilize communications circuitry 406 totransmit and/or receive data front a variety of data sources.

It should be appreciated that, in some embodiments, barcode capturecircuitry 410 may include a separate processor, specially configuredHeld programmable gate array (FPGA), or application specific interfacecircuit (ASIC) to perform the above-described functions. Barcode capturecircuitry 410 is therefore implemented using hardware components of theapparatus configured by either hardware or software for implementingthese planned functions. In some example implementation, barcode capturecircuitry 410 may (either directly or through the user of processor 402,memory 404, communications circuitry 406, and/or input/output circuitry408) interact with other systems and/or processes, including but notlimited to those associated with Honeywell's Swift Decoder software.

As described above and as w ill be appreciated based on this disclosure,example embodiments may be implemented by a plurality of devices, suchas fixed devices, mobile devices, backend network devices, and/or thelike. Accordingly, embodiments may comprise various means includingentirely of hardware or combination of hardware with software.Furthermore, embodiments may take the form of a computer program productstored on at least one non-transitory computer-readable storage mediumhaving computer-readable program instructions (e.g., computer software)embodied in the storage medium. Any suitable computer-readable storagemedium may be utilized including non-transitory hard disks, CD-ROMs,flash memory, optical storage devices, or magnetic storage devices.

It should be appreciated, with respect to certain devices embodied byapparatus 400, as described in FIG. 4 computer program instructionsand/or other type of code may be loaded onto a computer, processor orother programmable apparatus's circuitry to produce a machine, such thatthe computer, processor other programmable circuitry that execute thecode on the machine create the means for implementing various functionsdescribed herein.

Having described specific components of example devices (e.g., apparatus400), that may carry out some of the functionality of the systemdescribed herein, example implementations of embodiments of the presentinvention are described below in connection with a series of flowcharts.

Operations Performed by an Augmented Reality Viewing Device

Turning to FIG. 5 , a flowchart is illustrated that contains operationsperformed by a augmented reality viewing device to present a renderedimage of a scanning device to a user within an augmented realityenvironment and capture a barcode on a target item. The operationsillustrated in FIG. 5 may, for example, be performed by, with theassistance of, and/or under the control of an apparatus 400 which inturn may be a component of an augmented reality viewing device (e.g.,augmented reality viewing device 104), and more particularly through theuse of one or more of processor 402, memory 404, communicationscircuitry 406, input/output circuitry 408, and barcode capture circuitry410.

Turning first to operation 502, the apparatus 400 may include means,such as processor 402, input/output circuitry 408, barcode capturecircuitry 410, or the like for detecting a target object within a fieldof view of an augmented reality viewing device 104. As described above,the term “target object” as used herein may refer to any object, item,article, surface, etc., placed in a Held of view of a scanning devicefor scanning. In some example implementations, the target object mayhave an encoded indicia, such as a barcode for example, located on thetarget object. With reference to operation 502, in an exampleimplementation, the augmented reality viewing device 104 may detect atarget object comprising a barcode within a field of view of theaugmented reality viewing device 104. In this regard, the augmentedreality viewing device 104 may include and/or incorporate a cameraand/or other scanning device, for viewing and identifying a marker, suchas a barcode and/or other indicator located on an object. The augmentedreality viewing device 104 may identify the object with a marker as atarget object. In some example implementations, the augmented realityviewing device 104 and/or an associated camera may compare an image ofan object within the field of view of the augmented reality viewingdevice 104 against a target object database for identifying if theobject is a target object. For example, the target object database maybe stored in the memory 404 of the apparatus 400. The target objectdatabase may be configured by a user and/or a manufacturer and may beupdated regularly by the user and/or a server. In another exampleimplementation, the target object database may be accessible by theaugmented reality viewing device 104 via communication between theaugmented reality viewing device 104 and other systems, such as but notlimited to, a server and/or a cloud.

Further, the augmented reality viewing device 104 may be configured todetect a barcode image within the field of view of the augmented realityviewing device 104, by identifying known patterns, such as a pattern oflight and dark lines, rectangles, dots, hexagons and other geometricpatterns in two dimensions, or the like. In some exampleimplementations, the augmented reality viewing device 104 may comprise awide angle detection camera for detecting an object within a field ofthe augmented reality viewing device 104, and a narrow angle detectioncamera for analyzing one or parameters associated with the object, todetermine if the object may be identified as a target object. It shouldbe noted that the example embodiments above are not limiting, and anyother object detection method, including but not limited to depthsensing, infrared (IR) imaging, laser, thermal imaging, and the like,may alternatively and/or additionally be used to detect a target objectwithin a field of view of an augmented reality viewing device 104.

Turning next to operation 504, the apparatus 400 may include means, suchas processor 402, memory 404, communications circuitry 406, input/outputcircuitry 408, barcode capture circuitry 410, or the like, for renderingan image of a scanning device within the field of view of the augmentedreality viewing device 104. As described above, with reference to FIG.1-2 , an image of a scanning device 106 may be rendered within a fieldof view of the augmented reality viewing device 104. In order to capturean image of a target object 108, the user 102 may use the rendered imageof the scanning device 106 as an image capturing aid indicating anactive scan and/or read area within the field of view of the augmentedreality viewing device 104. The user 102 may intuitively position thetarget object 108 having a barcode 110 in front of the rendered image ofthe scanning device 106. In an example implementation, with reference tooperation 504, the image of the scanning device may be rendered as acombination of right-eye and left-eye augmented reality images renderedon right-eye and left-eye displays of the augmented reality viewingdevice 104. In other embodiments, the image of the scanning device maybe rendered using any known three-dimensional imaging technology, suchas, but not limited to, polarized shutter technology, auto stereoscopy,holograms, and the like. In an example implementation, the augmentedreality viewing device 104 may comprise an autostereoscopic display. Inthis regard, the autostereoscopic display may render left and rightimages to the left and right eyes of a user using any of a number oftechniques including, but not limited to, a parallax barrier, alenticular lens, a micro lens, and the like.

Further, the processor 402, memory 404, communications circuitry 406,input/output circuitry 408, barcode capture circuitry 410, or the like,may render the image of the scanning device at a specific locationwithin the Held of view of the augmented reality viewing device 104. Insome example implementations, a rendering location of the image of thescanning device may be determined based on an active scan and/or readarea of the augmented reality viewing device 104. Specifically, theprocessor 402 and/or a rendering engine of the augmented reality viewingdevice 104 may determine an area within the Held of view of theaugmented reality viewing device 104 and/or an associated camera withoptimal or close to optimal scanning and/or imaging capturingparameters, as the active scan and/or read area. The processor 402and/or a rendering engine of the augmented reality viewing device 104may position the rendered image of the scanning device 106 such that therendered image of the scanning device 106 may point towards the activescan and/or read area of the augmented reality viewing device 104 and/oran associated camera. In some example implementations, a renderingposition, location, and/or orientation of the image of the scanningdevice may be predetermined relative to the user and/or the augmentedreality viewing device 104. The predetermined location may be stored inthe memory 404 of the augmented reality viewing device 104 and/or may beaccessible to the augmented reality viewing device 104 from a serverand/or a cloud. In other embodiments, a rendering position, location,and/or orientation of the image of the scanning device may be determinedin real time by the augmented reality viewing device 104 and/or anyassociated circuitry.

In some example implementations, the rendering position, location,and/or orientation of the image of the scanning device may change if thefield of view of the augmented reality-viewing device is altered. Forexample, if a user wearing a head mounted device turns his/her headtowards right, the field of view of the head-mounted device and/or anassociated camera shifts to the right, and thus, the position andlocation of the image of the scanning device may also be movedaccordingly. Thus, the image of the scanning device may be dynamicallypositioned within the field of view of the user such that it indicatesthe current scan and/or read area of the augmented reality viewingdevice 104 and/or associated camera. In other example implementationsembodiments, the rendering position, location, and/or orientation of theimage of the scanning device may be changed if the user moves therendered scanning device through a gesture and/or a command based onhis/her preference. Further, the augmented reality viewing device 104and/or any associated circuitry may additionally determine one or moregraphical characteristics associated with the image Gf the scanningdevice, such as, but not limited to, texture, color, size, etc., and mayrender the image of the scanning device accordingly. In some exampleimplementations, the augmented reality viewing device 104 may facilitatea user 102 to modify or set the graphical characteristics associatedwith the image of the scanning device as per his or her preference. Forexample, the apparatus 400 may include means, such as the input/outputcircuitry 408 that may, in turn, be in communication with the processor402 to receive an indication of user input to modify or set thegraphical characteristics associated with the image of the scanningdevice.

Turning next to operation 506, the apparatus 400 may include means, suchas processor 402, memory 404, communications circuitry 406, input/outputcircuitry 308, barcode capture circuitry 410, or the like, for renderinga scanning area within the field of view of the augmented realityviewing device. In an example implementation, a scanning area may berendered along with and/or in place of the rendered image of thescanning device, as described above. The scanning area may be rendereddepicting the active scan and/or read area of the augmented realityviewing device 104. In some example implementations, the scanning areamay be rendered in front of the rendered image of the scanning device,depicting a sub-field of view of the scanning device within the field ofview of the augmented reality viewing device 104. In other exampleimplementations the scanning area may be rendered as a polygon, and/oras a three-dimensional conical area expanding from the augmented realityviewing device 104 depicting a field of view of a camera associated withthe augmented reality viewing device 104. Further, the above descriptionof rendering and/or positioning an image of the scanning device, withreference to operation 504, may apply to the rendering and/orpositioning of the scanning area, with reference to operation 506. Insome example implementations, the scanning area may be athree-dimensional depiction of a scanning area of a camera associatedwith the augmented reality viewing device 104 and may depict an activeread and/or scan area of t be augmented reality viewing device 104 asperceived from the perspective of the user. Thus, the scanning area maybe positioned to depict a specific area within the field of view of theaugmented reality viewing device 104 and/or an associated camera whereone or more image capturing parameters, such as, but not limited to,focus, lighting, exposure, etc., may be optimal and/or otherwisesufficient for capturing an image, such as a barcode image.

Turning next to operation 508, the apparatus 400 may include means, suchas processor 402, memory 404, communications circuitry 406, input/outputcircuitry 408, barcode capture circuitry 410, or the like, for capturingan image of a barcode located on the target object. In an embodiment,the image of the barcode located on the target object may be captured bya camera associated with the augmented reality viewing device 104. Inaccordance with some example implementations, the image of the barcodelocated on the target object may be captured by a high-resolutiondigital camera, a low-end PC camera, or a camera with any other suitableresolution, personal data assistants (PDAs), laptop computers, tabletcomputers, smart books, palm-top computers, personal computers,smartphone, headset, smart watch, and similar electronic devicesequipped with at least a camera. Further, the image of the barcode maybe captured in a single frame, in multiple frames followed by imagestitching, or using any other available image capturing and/orprocessing technique. In some example implementations, the image of thebarcode located on the target object may be captured automatically bythe camera associated with the augmented reality viewing device 104 whenthe target object is within the rendered scanning area. In otherembodiments, the image capturing of the barcode may be triggered by auser action, such as holding the rendered scanning device and pressing atrigger, or performing a predetermined gesture designated for imagecapturing.

In some example implementations, once the image of the image of thebarcode located on the target object is captured by the cameraassociated with the augmented reality viewing device 104, the processor402 and/or the barcode capture circuitry 410 may process the barcodeimage. In some example implementations, the processor 402 and/or anyassociated circuitry may detect a presence of a barcode pattern in thebarcode image. The processor 402 may then determine the location, thebounding shape and/or size of the barcode pattern. Further, theprocessor 402 may apply a decoder algorithm on an enclosed regioncomprising the barcode pattern to decode the information encoded by thebarcode. The decoding algorithm may analyze the barcode pattern toidentify a sequence of narrow and wide bars, spaces, etc. to be comparedagainst a symbology character set and/or be read as a bit stream. Theanalyzed pattern may then be used to obtain any stored informationassociated with the barcode, such as, but not limited to, objectdetails, dimensions, pricing information, linked network address, or thelike. The decoded barcode pattern and/or the decoded information may besent to the server and/or any associated devices by the augmentedreality viewing device 104. In some example implementations, theaugmented reality viewing device 104 may send the captured image of thetarget object and/or the barcode to a server and/or any associateddevice for processing and decoding the barcode. The augmented realityviewing device 104 may send a secure copy of the captured image.Further, the augmented reality viewing device 104 may perform a check,to ensure that the image quality is sufficient for processing and/ordecoding the barcode by other systems, or may receive a confirmationfrom the server and/or associated devices that the image is beingprocessed and/or that the barcode is decoded. In an embodiment, theaugmented reality viewing device 104 may receive decoded barcodeinformation from the server and/or associated devices.

As described above, example embodiments of the present invention thusprovide a wearable scanning device which provides an indication of aviewing area of the scanning device to serve as an aid for a user toposition a target object in the viewing area for efficient and quickimage capturing.

FIG. 5 illustrates example flowchart describing operations performed inaccordance with example embodiments of the present invention. It will beunderstood that each block of the flowcharts, and combinations of blocksin the flowcharts, may be implemented by various means, such ashardware, firmware, one or more processors, circuitry and/or otherdevices associated with execution of software including one or morecomputer program instructions. For example, one or more of theprocedures described above may be embodied by computer programinstructions residing on a non-transitory computer-readable storagememory. In this regard, the computer program instructions which embodythe procedures described above may be stored by a memory of an apparatusemploying an embodiment of the present invention and executed by aprocessor of the apparatus. As will be appreciated, any such computerprogram instruct ions may be loaded onto a computer or otherprogrammable apparatus (e.g., hardware) to produce a machine, such thatthe resulting computer or other programmable apparatus provides forimplementation of the functions specified in the flowchart blocks. Whenexecuted, the instructions stored in the computer-readable storagememory produce an article of manufacture configured to implement thevarious functions specified in flowchart blocks. Moreover, execution ofa computer other processing circuitry to perform various functionsconverts the computer or other processing circuitry into a particularmachine configured to perform an example embodiment of the presentinvention. Accordingly, the operations set forth in the flowchartsdefine one or more algorithms for configuring a computer or processor,to perform an example embodiment. In some cases, a general purposecomputer may be provided with an instance of the processor whichperforms algorithms described in one or more flowcharts to transform thegeneral purpose computer into a particular machine configured to performan example embodiment.

Accordingly, the described flowchart blocks support combinations ofmeans for performing t be specified functions and combinations ofoperations for performing the specified functions. It will also beunderstood that one or more flowchart blocks, and combinations offlowchart blocks, can be implemented by special purpose hardware-basedcomputer systems which perform the specified functions, or combinationsof special purpose hardware that execute computer instructions.

In some example embodiments, certain ones of the operations herein maybe modified or further amplified as described below. Moreover, in someembodiments additional optional operations may also be included. Itshould be appreciated that each of the modifications, optional additionsor amplifications described herein may be included with the operationsherein either alone or in combination with any others among the featuresdescribed herein.

The foregoing method descriptions and the process flow diagrams areprovided merely as illustrative examples and are not intended to requireor imply that the steps of the various embodiments must be performed inthe order presented. As will be appreciated by one of skill in the artthe order of steps in the foregoing embodiments may be performed in anyorder. Words such as “thereafter,” “then,” “next,” etc. are not intendedto limit the order of the steps: these words are simply used to guidethe reader through the description of the methods. Further, anyreference to claim elements in the singular, for example, using thearticles “a,” “an” or “the” is not to be construed as limiting theelement to the singular.

The hardware used to implement the various illustrative logics, logicalblocks, modules, and circuits described in connection with the aspectsdisclosed herein may include a general purpose processor, a digitalsignal processor (DSP), a special-purpose processor such as anapplication specific integrated circuit (ASIC) or a field programmablegate array (FPGA), a programmable logic device, discrete gate ortransistor logic, discrete hardware components, or any combinationthereof designed to perform the functions described herein. Ageneral-purpose processor may be a microprocessor, but, in thealternative, the processor may be any conventional processor,controller, microcontroller, or state machine. A processor may also beimplemented as a combination of computing devices, e.g., a combinationof a DSP and a microprocessor, a plurality of microprocessors, one ormore microprocessors in conjunction with a DSP core, or any other suchconfiguration. Alternatively or in addition, some steps or methods maybe performed by circuitry that is specific to a given function.

In one or more example embodiments, the functions described herein maybe implemented by special-purpose hardware or a combination of hardwareprogrammed by firmware or other software. In implementations relying onfirmware or other software, the functions may be performed as a resultof execution of one or more instructions stored on one or morenon-transitory computer-readable media and/or one or more non-transitoryprocessor-readable media. These instructions may be embodied by one ormore processor-executable software modules that reside on the one ormore non-transitory computer readable or processor-readable storagemedia. Non-transitory computer-readable or processor-readable storagemedia may in this regard comprise any storage media that may be accessedby a computer or a processor. By way of example but not limitation, suchnon-transitory computer-readable or processor-readable media may includeRAM, ROM, EEPROM, FLASH memory, disk storage, magnetic storage devices,or the like. Disk storage, as used herein, includes compact disc (CD),laser disc, optical disc, digital versatile disc (DVD), floppy disk, andBlu-ray disc™, or other storage devices that store data magnetically oroptically with lasers. Combinations of the above types of media are alsoincluded within the scope of the terms non-transitory computer-readableand processor-readable media. Additionally, any combination ofinstructions stored on the one or more non-transitory processor-readableor computer-readable media may be referred to herein as a computerprogram product.

Many modifications and other embodiments of the inventions set forthherein will come to mind to one skilled in the art to which theseinventions pertain having the benefit of teachings presented in theforegoing descriptions and the associated drawings. Although the figuresonly show certain components of the apparatus and systems describedherein, it is understood that various other components may be used inconjunction with the supply management system. Therefore, it is to beunderstood that the inventions are not to be limited to the specificembodiments disclosed and that modifications and other embodiments areintended to be included within the scope of the appended claims.Moreover, the steps in the method described above may not necessarilyoccur in the order depicted in the accompanying diagrams, and in somecases one or more of the steps depicted may occur substantiallysimultaneously, or additional steps may be involved. Although specificterms are employed herein, they are used in a generic and descriptivesense only and not for purposes of limitation.

What is claimed is:
 1. A method for capturing an image of a targetobject within an augmented reality environment, the method comprising:detecting the target object within a field of view of a user of anaugmented reality viewing device, comprising: comparing an image of anobject within the field of view of the user of the augmented realityviewing device based on a target object database to identify that theobject is the target object; rendering a scanning area within the fieldof view of the user of the augmented reality viewing device, whereinrendering the scanning area comprises rendering a three-dimensionalrepresentation of an active read area of a camera associated with theaugmented reality viewing device in a first graphical characteristic ofthe scanning area; in response to determining that the target object islocated within the active read area of the camera, rendering thethree-dimensional representation of the active read area of the camerain a second graphical characteristic of the scanning area that isdifferent from the first graphical characteristic; and in response tothe target object being in the scanning area, capturing, by the cameraassociated with the augmented reality viewing device, the image of thetarget object.
 2. The method of claim 1, further comprising rendering athree-dimensional image of a scanning device with the field of view ofthe user of the augmented reality viewing device.
 3. The method of claim1, further comprising: in response to determining that the target objectis not located within the active read area of the camera, rendering thethree-dimensional representation of the active read area of the camerain a third graphical characteristic of the scanning area that isdifferent from the first graphical characteristic and the secondgraphical characteristic.
 4. The method of claim 3, further comprising:in response to determining that the target object is captured by thecamera within the active read area, rendering the three-dimensionalrepresentation of the active read area of the camera in a fourthgraphical characteristic of the scanning area that is different from thefirst graphical characteristic, the second graphical characteristic, andthe third graphical characteristic.
 5. The method of claim 1, whereincapturing the image of the target object further comprises removing thescanning area from the field of view of the user of the augmentedreality viewing device.
 6. The method of claim 1, wherein capturing theimage of the target object further comprises causing an audible sound tobe emitted from the augmented reality viewing device.
 7. The method ofclaim 1, wherein the augmented reality viewing device comprises abinocular augmented reality headset.
 8. An apparatus for capturing animage of a target object within an augmented reality environment, theapparatus comprising: a processor, wherein the processor is configuredto: detect the target object within a field of view of a user of theapparatus, wherein the processor is further configured to: compare animage of an object within the field of view of the user of the apparatusbased on a target object database to identify that the object is thetarget object; render a scanning area representing a viewing area of acamera associated with the apparatus within the field of view of theuser of the apparatus, wherein the scanning area comprises athree-dimensional representation of an active read area of the camera ina first graphical characteristic of the scanning area; in response todetermining that the target object is located within the active readarea of the camera, render the three-dimensional representation of theactive read area of the camera in a second graphical characteristic ofthe scanning area that is different from the first graphicalcharacteristic; and in response to the target object being in thescanning area, cause the image of the target object to be captured bythe camera associated with the apparatus.
 9. The apparatus of claim 8,wherein the processor is further configured to: render athree-dimensional image of a scanning device within the field of view ofthe user of the apparatus.
 10. The apparatus of claim 8, wherein theprocessor is further configured to: render the scanning area of thecamera in a third graphical characteristic of the scanning area that isdifferent from the first graphical characteristic and the secondgraphical characteristic, in response to determining that the targetobject is not located within the scanning area of the camera.
 11. Theapparatus of claim 10, wherein the processor is further configured to:render the scanning area of the camera in a fourth graphicalcharacteristic of the scanning area that is different from the firstgraphical characteristic, the second graphical characteristic, and thethird graphical characteristic, in response to determining that thetarget object is captured by the camera within the scanning area. 12.The apparatus of claim 8, wherein the processor is further configuredto: remove the scanning area from the field of view of the user of theapparatus on capturing the image of the target object.
 13. The apparatusof claim 8, wherein the processor is further configured to: cause anaudible sound to be emitted from the apparatus on capturing the image ofthe target object.
 14. The apparatus of claim 8, wherein the apparatuscomprises a binocular augmented reality headset.
 15. A computer programproduct comprising at least one non-transitory computer-readable storagemedium having computer-executable program code stored therein, thecomputer-executable program code comprising program code instructionsconfigured to: detect a target object within a field of view of a userof an augmented reality viewing device, wherein the computer-executableprogram code comprises program code instructions configured to: comparean image of an object within the field of view of the user of theaugmented reality viewing device based on a target object database toidentify that the object is the target object; render a scanning arearepresenting an active read area of a camera associated with theaugmented reality viewing device within the field of view of the user ofthe augmented reality viewing device, wherein the scanning areacomprises a three-dimensional representation of the active read area ofthe camera in a first graphical characteristic of the scanning area; inresponse to determining that the target object is located within theactive read area of the camera, render the three-dimensionalrepresentation of the active read area of the camera in a secondgraphical characteristic of the scanning area that is different from thefirst graphical characteristic, wherein a change from the firstgraphical characteristic to the second graphical characteristic isgradual relative to an area of the target object within the scanningarea; and in response to the target object being in the scanning area,capture, by the camera associated with the augmented reality viewingdevice, an image of the target object.
 16. The computer program productof claim 15, further comprising program code instructions configured to:render a three-dimensional image of a scanning device in the field ofview of the user of the augmented reality viewing device.
 17. Thecomputer program product of claim 15, further comprising program codeinstructions configured to: render the scanning area of the camera in athird graphical characteristic of the scanning area that is differentfrom the first graphical characteristic and the second graphicalcharacteristic, in response to determining that the target object is notlocated within the scanning area of the camera.
 18. The computer programproduct of claim 17, further comprising program code instructionsconfigured to: render the scanning area of the camera in a fourthgraphical characteristic of the scanning area that is different from thefirst graphical characteristic, the second graphical characteristic, andthe third graphical characteristic, in response to determining that thetarget object is captured by the camera within the active read area. 19.The computer program product of claim 15, further comprising programcode instructions configured to: remove the scanning area from the fieldof view of the user of the augmented reality viewing device on capturingthe image of the target object.
 20. The computer program product ofclaim 15, further comprising program code instructions configured to:cause an audible sound to be emitted from the augmented reality viewingdevice.